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ABSTBACT 

Although various assessments differ in notable ways, 
they often follow a plan that is thoroughly tested and features four 
basic steps; (1) selecting learning areas and identifying their 
objectives; (2) developing achievement test items to determine the 
degree to which these objectives are accomplished; (3) administering 
xhe test Items to representative samples of students and gathering 
background data about them: and 0) analyzing the results and 
disseminating them to administors, board members, legislators, and 
the public. The largesst, most informative assessment ever designed 
follows this general plan very closely. It is the National Assessment 
of Educational Progress (HAB£^) , for which planning began in 196*». It 
is designed to obtain census-like data on the knowledges, skills, 
concepts, understandings, and attitudes possessed by young Americans 
in a variety of learning areas; and to measure the growth or declinp 
of these achievements that occurs over time. This publication 
describes the NAEP and some major findings of the first assessments 
in various areas, and then offers a speculative view of our schools. 
Surveys like the KAEP serve as excellent vehicles for generating 
hypotheses about causes of achievement fluctuations, which in turn 
can be studied more intensively by designing appropriate experiments 
or conducting thorough case studies. (EC) 
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THE NEED FOR ASSESSING ACHIEVEMENT 

Have you tried to balance your checkbook lately? If so, with 
what success? For most of us in our post-secondary school years 
this IS (or should be) a monthly task> one which we probably 
view with mixed feelings. The cause of these feelings is easily 
identified: Balancing d checkbook is difficult even ihough it re- 
quires only simple addition and subtraction. Are you surprised to 
know that when a national sample of young adults (ages 26 to 
35) received canceled checks, a bank statement, and a personal 
register in which checks had been recorded, barely 16 percent 
c"uld reconcife the personal record with the bank record? 

Now consider another everyday activity— voting. A typical bal- 
lot was given to 17-year-olds and young adults and, with it be- 
fore them fo^ careful study, five questions were asked about the 
voting options available. About 41 percent of the 17-yGar-olds 
and 44 percent of the young adults could answer these questions 

Fmaliy, a small sGctton of an ordinary television schedule was 
shown to young Americans of ages 9, 13^ 17^ and 26 35, and 
(ive questions were asked about the program selections avail- 
able. When allowed generous time limits and ample opportunity 
to refer repeatedly to the printed schedule, approximately 11 per- 
cent of the 9-yfiar-ofds, 34 percent of the 13-year-oids, 53 per- 
cent of the 17-year-ofds, and 62 percent of the young adults 
were able to answer the questions. 

What is your reaction to these percentages? Qo you find the 
success rates pleasing or disturbing? Are they consistent with 
your levels of expectation? In shorts do these results augfjest 
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that our educational system is largely succeeding or (ailing in 
these instances? Th^se are important questions that deserve 
answers. 

To be sure> the foregoing three examples provide only a few 
isolated bits of information about the achievements of American 
youth. Suppose that we had hundreds more^ collectively repre- 
senting all of the major learning aroas of concern to schools. 
Actually many hundreds are available—^the products of a major 
r^ationat achievement survey liesigned to obtain solid data about 
the principal outcomes of our education system— in other words, 
what students are learning. With those in hand, we are better 
able to understand our educational programs and formulate im* 
presslons about them. 

Too frequently our opinions about* the quality of American 
schooling are based only on rather vague general impressions 
from the past and a scattering of recent firsthand exp^^riences. 
Useful as these are. they fail to provide a broads strong ba^is for 
making the complex educational decisions we face. Now roore 
than ever we need definitive information dKMi the achievements 
of American youth. After careful study of such information, we 
should be better able to identify the strengths and weaknesses 
of our educational enterprise^ ihen mount bold, innovative pro- 
grams to improve it where necessary. 

Traditionally, accreditation procedures have provided good 
information about the inputs and processes of education but 
fittle about the outcomes. In the last decade^ assessments of stu- 
dent outcomes hav& been developed and implemented, which 
supplement the accreditation efforts very well. These are census* 
like surveys of levels of student achievement, emphasizmg the 
studerts' intellectual changes that have occurred largely because 
of schooling. Typically they provide hard data about students as 
groupSy not as iiulividuafs. and thereby familiarize us with the 
"big picture" of student change. 



Methods of Assessing Student Achievement 

Every day major national surveys are completed and their re- 
sults disseminated to the public. Most prominent is the poputa* 
lion census taken e\-ery ten years. Also highfy visible are health 
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stahsttcs contoTnmg various diseases, uncmploymonl data, the 
fjross national produth jnd ihc consumer price indc\. These «re 
closely WdUhcd* and doci^ijn makcr*> respond lo them. Economic 
daia such as changes in unemployment levels* for example^ can 
Cduse government untU to adjust thefr estimates of tax income^ 
public officials to modify their economic and social programs, 
and mvestors to increase their buying or selling of common 
stocks. The consurr<er price index is tied to a number of major 
labor contracts and retirement programs^ «^nd its major fluctua- 
tions can cause income shifts for many thousands of people. 

fn education we are now developing data of comparable im- 
portance through local* vtate^ and national assessments. Their 
purpose to determine leveb of student achievement in major 
learning area^ schools are concerned with« repeating the mea- 
surements every three to ^ix years to discover changes. Need- 
less to say, the direction and size of such changes are of vital 
interest to educational decision makers, 
A Ceneraf P/an ^or Asscssmcnl 

Although varicjus assessments differ in notable ways, they 
often follow a general plan that is thoroughly tested. It has t jui 
basic steps; 

1, Selecting learning areas and identifying their objectively. 

2, Developing achievement test item^ to determine the degree 
to which these objectives are achieved, 

3, Admini*>tering the test items to representative samples of 
students and gathering background data about them, 

4, Analy2ing the results and disseminating them to educators^ 
board members, legislators, and the public, 

teamfng areas and their ob{ectlve$. The learning areas to be 
induded must be selected and the objectives and subobjectives 
of these areas must be determined. Often the assessment con* 
centrates on the basic skills of reading* writing, and mathemat- 
ics. Sometimes content areas like science and social studies are 
added, The^e ^e[ection*> are made with the help of advisory com- 
mittees composed of the public* teachers, and specialists. Their 
choicei> represent the most pre*>*>ing needs for information exist- 
ing at that time. 

Committees of the same general composition then tackle an 
Q "ven more difficult task, formulating the irijor and subob* 
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jectives of each learning area. an illustration, in s^ien^e they 
might agree thai a m*ii(>r objedive is, ''The student knows the 
fundamental facts und printipk-s ol science/' The many subob- 
jcctives included within this major objective would de<il with 
knowledge of facts and simpk concepts, laws ar^d principles, 
conceptual schemes, and the scientific enterprises. 

Since these are consensus objectives^ they do not Include all 
aspects of the learning area. But beycnd question they do repre- 
sen? the main core of the subject matter— the central jdeas dbout 
which every school should be concerned, 

Uevoloptng measuring instruments* How can we tell (he de- 
gree to which the objectives have been achieved? U's simple^ 
by administering appropriate achievement test^ to <i representa- 
tive sample of students. But os the objectives ch*inge so should 
the tests. This means that it is highly unlikely that suitable 
tests can merely be purchased. Most often they must be new 
tests specifically designed in terms of the objectives of the learn- 
ing area being assessed. Thus the test Is tailored to these ob- 
jectives. 

Buiklint; t^itlored tests of this kind is time consuming and 
expensive GeneMlly speakings at least one and perhaps ten or 
more test items are use(f for each major or subobjeclive. The 
number varies consKfrrablV' depending upon the number of ob- 
jectives, the amount of testing time available^ and the type of 
information needc'd. 

Cach test item should be designed so that it reLites directly 
to the objective under consideration. In this way determining 
the percentage of students who can *inswer the test item cor- 
rectly provides on estimate of the degiee to vvhi(h the objec- 
has bcHjn *Khleved, Inspection of wrong answers offers In- 
sight<^ into the origin of faulty learning and possible remedial 
<ictions. 

As you can see, the fuiGgoing testing method places much 
emphasis on the responses of ^'rou/>s of students to a wng/e test 
Item, r*ither than the responses of a sifij^/e sti^dent to many test 
items. The second method is the one commonly used in class- 
rooms tod<i> to identlfv the relative standing of <i student in re^ 
latronship to his peers, Su^h te^t^ perform thi^ function well but 
~ nnot be easily usH in modern assessment plans. 
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Administering the achrcvemenl test items. Rarely is it ncccs' 
snry or even dcsirablo to administer all test items to alt students. 
Often the sampling techniques gsnd permit high quality data 
about levels of student achievement to be obtained by adminiS' 
tering a part of the total group of test items to a sample of stu- 
dents. The student sample can be obtained by randomly selecting 
students from a defined population of students (for example* all 
IS^year-olds in a school district) or classes of students from a de- 
fined population of classes (for example* all eighth grades in a 
school district). 

Background data about the student and the school are extremely 
helpful when interpreting the achievement data. In relation to 
the student, these might include the educational level and socio- 
economic status of parents. For the school, commonly gathered 
data are the average dass size* average per student cost* and 
major features of the curriculum and teaching methods used. If 
substantial persistent re}.itlor;ships can be found between the out* 
comes (that is* levels of achievement) and the inputs and pro- 
cesses, then decision makers have sturdy tools with which to di- 
rect efforts to improve the educational process. 

Analyxing the data and disseminating the findings. Data an- 
alyses vary because they are designed to fit the specific features 
of the data-gathering effort. Nevertheless, three themes are 
usually found. First> the results are often reported both on the 
success/failure rate of groups of students on each test item and 
on clusters of very similar test items (for instance, all test hem 
associated with a given objective). Second> estimates are made 
of the relationships between levels of achievement ^ind input 
and process variables^ or combinations of them. Thirds small* 
trivial differences and relationships are Ignored. They are not 
educationally important. 

Multiple reports are written because multiple audiences exist. 
A series of reports covering a variety of learning areas during 
a period of years is an unmatched reservoir of information of 
high quality* useful in a variety of ways for improving education. 

The National Assessment of Educational Progress: 
Goal; and Methods 
The largest! most mJori)i?tive assessment ever designed follows 
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the genera) plan described very closely. U Is the National Assess- 
ment of Educational Progress (NAEP)* for which planning began 
in 1964. Its basic goal is to describe what young Americans know 
and can do. More specifically^ it is designed 1) to obtain census- 
like data on the knowledges^ skillSi concepts^ understandings, 
and attitudes possessed by young Americans in a variety of 
learning areas; and 2} to measure the growth or declme of these 
achievements that occurs over time. 

To accomplish the foregoing^ NAEP selected ten learning areas 
for assessment and formulated objectives and subobjeciives for 
each whh the help of comnr>ittees of teachers^ scholars, and con- 
cerned lay people. For an objective or subobjectlve to be useful 
in the as&es&ment^ there must be agreement that it is reflective 
of acceptable teaching goals^ important for a young person in 
today's society, and meaningful to subject-matter specialists. 
The learning areas seleaed include those receiving primary 
attention in the elementary and secondary schools (for example, 
the basic skills) and some of those receiving secondary emphasis 
(for example, music and art). The ten areas are: 

Reading Citizenship 
Writing Music 
Mathematics Art 
Science Literature 
Social Studies Career and Occupational 

Development 

Four groups were chosen for testing; 9-year-olds. 13- 
year-olds. 17-year-olds, ^nd young adults (ages 26 to 35). The 
first three ages represent crucial points in one's educational 
career, while the last is at ot beyond the terminal point of 
most formal education. Annually NAEP draws natioiwl samples of 
young Americans in most or all of these age groups and mea- 
sures their levels o^ achievement in one or more learning areas. 

After the objectives and subobjectives are established in a ler^rn* 
ing area, test items are constructed to represent each of them. 
Some of these test items are unlike tho&e found in the tpykal 
achievement tests used in schools. Varieties of materials, includ- 
ing motion pictures^ graphs and tables, audio presentations, and 
narrative texts are used as the basis for the student's task. Fur- 
I thermore, the type of student response requUed varies from 
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checkinfj a corrcil tin^vvvr or providing' lengthy wriUen responses 
{such as writing on e^^oy or j^iving reasons for an aiiswer)> to 
performttig (such as usmg suenllfic <ipparatus« singing and play- 
ing inslruments^ and drawing a picture). 

levels ol anhievement m a leiirning area are determined by 
administering test ttems to young Americans selected in the na- 
tional sample. No one b tested more thai> once« but some test 
items are used a second or third time when a le^irning area is 
reassessed. 

>^ssessi7ie/if Schc^kths 

)n large measure^ NAEP follows a systematic plan for assess- 
ing achievement levels in the ten '.earning areas. Those assess- 
ment^ completed are listed in Tablr 1. 

ruble 1 

AssessmenI** Completed by the 
National Assesstrient of Educational Progress 



Jfea^ Lf arninti Area 

l%9-70 science* Writing* Citi/en^hip 

19H)71 Reading?. Literature 

197V72 Music , Social Siudies 

1972- 73 Mathematics, Science* 

1973- 7^ Career and Occup<itional Development, 

Writing* 

1974- 75 Art, Redding* 

1975- 76 _^!!ii£Pihifc^[f'L5l" _ 



•Secortd Assessment 



Of fructal (mportance are the second assessments. The result 
of a thorough reexamination of the objectives, they involve re- 
usmg about one-half of the lest items from the first assessment 
with a new sample of young Americans in most or all age groups. 
Now NAEP is measuring changes in levels of achievement, 

Vistifilize. if you will, a third and fourth assessment* each 
following Its predecessor by three to six years. By this means 
achievement trends over time can be known. National Assessment 
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is very ambittous in its plans for fulure reasscssmentb, prepar- 
ing for succeeding asso^sn^ents while it completes Initial ones. 
Imagine the questions that can be ansiveredi at least in part> 
by the data produced, for example: 

1^ Are the 9-year-olus living in the inner city developing therr 
reading skills so rapidly that their achievement in this learn- 
ing area will probably approach the national level within the 
next decade? 

2» Is there any shift over time in terms of understanding and 
applying the First Amendment to the Constitution by young 
adults living in the Northeast as contrasted with those Ijving 
in the Southeast? 

3 Will young Americans living in rural areas continue to improve 
their skills in science at o rate that far exceeds thot of the na- 
tion as a whole? 

4, Are 17-year-olcl and ycung adult women raising their level of 
proficiency in consumer mathematics to a degree that will sig- 
nificantly reduce the gap between them and men of the same 
ages? 

5 Will the direction and amount of change in levels oi achieve- 
ment in the basic skills be the same> for all practical pur* 
pose^, d^, those in the general subject-matter areas ifor ex- 
ample, science and social studies) or the fine arts (for ex- 
ample, music and art)? 

6. If the levels of achievemunt in a learning area drop aj time 
passes, what are the specific knowledges, understandings, 
skills, and attitudes with the greatest weaknesses and toward 
which special remedial programs can be directed. 

In order for NAEP to answer questions such as these, it must 
maintain a high degree of productivity lor a long period of time. 
Examining the highlights of its lindings provides a good idea 
about the produawity needed. 
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PROFILES OF STUDENT ACHIEVEMENT 



Within each of the ten learning areas> National Assessment 
determines the percent<<^t;^ i>f the respondents at each age who 
can acceptably answer a Mut^oon or successfully perform a task. 
The number of question^ itnd tasks used in each assessment 
varies according to tht. k^rnrng area» ranging from 300 to more 
than 500. The primary .vd^ner of reporting National Assessment 
results js to report the ^i.ii.entage success and failure for various 
subgroups of students and yOung adults for each test item or groups 
of similar test items. Consequently* literally thousands of pieces 
of data are available about the performance level of American 
youth in the learning areas reported. 

The percentages of acceptable and unacceptable responses 
for each test or cluster of related test items are reported by age 
groups, and. within each age group, by sex. geographic region, 
level of parental education^ size and type of community, and 
race. Thus rough but useful profiles, of student achievement are 
created. Table 2 presents a more detailed breakdown of the 
classifications used. 



Ma}or Findings: First Assessments by National Assessment 
Summarizing the findings of the first assessments by National 
Assessment »s most difficult. The following are a few of the high- 
lights resulting from ^ssscsslng nine learning areas— all the areas 
. t~*ed except art. 
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Table 2 

Subgroups of Uie NAEP National Sample Used 
for Reporting Results 



C las lotion 


Subgroups 


Age level 


9,13. 17>26lo 35 years 


S*jx 


Male 




Female 


Geographic region 


Northeau 




Southeast 




Central 




West 


Level of parental education 


No high school 




Some high school 




Graduate from high school 




Post high school 


Size and type ol community 


Inner city 




Affluent suburb 




Rural area 




Main big city 




Urban fringe 




Medium-aize city 




Small cicy 


Race 


Black 




White 



Genera/ Trends 

When each of the learning are^s is considered as a com- 
posite. One finds a large degree of consistency within National 
Assessment findings from one learning area to another. This is 
to say that the differences in relative achievement among sub- 
groups of the sample are largely consistent in direction even 
though they are not totally consistent in size. This can be illus- 
trated by examining the achievement levels oi some of these 
subgroups. 

Regions of the country. The level of performance in the 
northeastern portion of the country is typically higher than in 
•^le other three cogions in all nine learning areas reported. This 



less noticeable in the young adult group than in other age 
groups* The lowest level of perfoTm<ince is con*>i*>tently found in 
the bouthedbtern region* It should be noted^ however* that these 
differences are comparatively modest* For example, the South- 
east i^ normally no more than 5 percent below the national 
average. 

In the western region^ the achievement of S-year-olds is often 
below national levels, but by adulthood achievement i^ usually 
above national levels. All four age groups of young Americans 
in the central region typif^ally perform at or slightly above na- 
tional levels. 

Size and type o( community* Consider for a moment the 
performance of young Americans from the inner tity, the rural 
areasf and the affluent *>uburbs. The fir*>t group typjcally achieves 
least well by a wide margin. Thei>e deficits ere smaller, but still 
serious^ for citizenship and music* The rural youth do somewhat 
better but still perform well below the national average. On the 
other hand> with the exception of young adults, their achieve- 
ment levels in social <>tudies and music are only slightly below 
the national average, Tmallyf the affluent <>uburb groups exceed 
the national average consistently by an jmportant margin. This 
is most noticeable in mathematics. 

Sex* Male-femtile diftereines in achievement vary* Female 
respondents generally achieve at higher lev*.!, than male re- 
spondents in many learning areas. The exceptions are science 
and mathematics, with little difference existing in citizenship 
and social studies. In some areas* the female superiority in 
achievement is more pronounced at the school ages than for 
young adults. 

In science male respondents achieve at ti consistently higher 
levelf the advantage increasing with age. In mathematics the pic- 
ture is mixed* Females have a better command of the compu- 
tational aspects of arithmetic at age 13 but fail to achieve as 
well as men when young adult^^* In consumer vnathematics^ the 
level of achievement of males surpasses that of females at all 
ages, with the smallest difference at age 13 and increasingly 
larger differences at ages 17 and young adult* 

Educational level of parents* The highest level of education 
^ "ither parent of a respondent ii> classified into one of four 

16 
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categories, no UiJ\ school, some ht^jh school graduated from 
high school and po^l hi^h school uaintng. The lasi category 
includes any kind of formal education following htgh school 
graduation. 

It is clear from the NAEP data that the educational level of 
the parent of the respondent is also a vital factor in the stu- 
dent's level of achievement. Young Americans vvuh parents who 
have only a grade school education perform \qm well of alt. As 
the level of the parents* education increases to some high 
school then to completion of high school and ultimately to post 
high school education, the performance level of the re*>pondent 
increases markedly and with striking consistency in all nine 
areas of achievement reported. Particularly vivjd examples of this 
trend are found in the basic skills— mathematics, writings and 
reading, 

Race^ Assessment data for whites and blacks only are re- 
ported by National Assessment, Achievement levels for blacks 
typically fall below the national average, while those for whites 
are above. This pattern is very pronounced in science^ writing, 
reading, literature, social studies, and mathematics, less extreme 
but still notable in citizenship and musk. 

Reporting Ai^Oi/^menl Data Test item by Tesf /fern 

The genera] trends reported by NAEP paint a thought*pro* 
voking picture using only broad strokes. Much fine detail is lost. 
Aftor all it is much less useful to study the assessment data 
for each learning area as a composite than it is to examine 
group responses to cluster*^ of similar test items or, even better, 
individual test items one by one. In this way inferences can be 
drawn about the degree to which educational objectives have 
been achieved— the true goal of an assessment. 

The following ore very small samples of these data from each 
of the nine learning areas. These areas are classified in three 
groups, basic skill areas^ general subject-matter areas, and the 
humanities and fme arts areas, 

A Sample of Significant Fimlings: /Ja^k SkiU Arci^i 

Of the ten learning areas included in NAEP assessmentsi 
three are basic skills^ namely^ readings writing, and mathematics. 
Listening arid speaking skills ore not asse^^sed. Here are a few of 
^ '^e findings in these three areas: 

17 



16 



Reading {Assessment year: 1970-71), 

1, School-age males read less well thdn scliool-^ge females^ bui 
young adult men and women have about the same levels of 
reading achievement. 

2, Many school-age youngsters cannot read and understand 
simple directions^ such as those for playing a card game, us- 
ing a can of spray> or baking muffins. 

3. The overall reading ability of blacks is lower than that of 
whites. In some instances, the reading level of blacks is not as 
high as whites four years younger. Some evidence suggests 
that whatever factors contribute to this problem are influ- 
ential before the age of 9. 

4. A large proportion of 9->ear-olds do not use dictionaries well 
but about 90 percent of young Americans at the other three 
age levels have little difficulty. Furthermore^ few respondents 
in these three age groups have any trouble using the contents 
page of a weekly news magazine. 

WrtUng {Assessment year: 1%9-1970), 

1. Application blanks are a common writing task for Americans* 
but results show only about half of the nation's young adults 
actually fill in all the information acquired. 

2. Males are more adventurous and free in writing essays^ 
though females demonstrate a better command of writing 
mechanics. 

3. Nine-year-olds have limited vocabularies, restricted skill in 
sentence construction^ and incomplete understanding of the 
conventions of written English. Furthermore^ about half of the 
17-year-olds have some command of the basics of written 
English^ but they typically produce only simple sentences^ 
use common words, and express simple ideas. 

4. Commas.are the most difficult form of punctuation to master 
for all age levels. 

Mathematics (Assessment year: 1972-73), 

1. About three-fourths of the 9-year-olds, more than % percent 
of the 13-ycar-olds, and about 95 percent of the 17-ycar-olds 
can successlully complete sjmple addition regrouping problems 
Q 'nvolvfng one- and two-digit numbers. 
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2, Performance on subtractioa test items k generally lower than 
on addition exercises. Young adults have difficulty working 
with decimals and fall below the achievement levek of 17-year- 
olds in this area, 

3, Fewer than half of the 17-year-olds and young adults can suc- 
cessfully determine the most economical package size of food 
products when making cost comparisons, 

4, Performance in consumer mathematics is definitely betow 
the national average for young Americans who live in the 
inner city, who live in the Southeast^ who are blacL and 
whose parents have little or no high school education. Fre- 
quently those who have least money to spend are al^^c tJivitr 
lacking skills to manage it, 

A Samp/e of Slgnifloini Findings. Conera/ Sub;ect-Waf(ef Area^ 

Social studies and science are subject-matter areas of con- 
siderable prominence in today's schools. They are substantia] 
parts of both the elementary and secondary school curriculum. 
Citizenship, which b much like social studies, b included in this 
group as well, even though it b not a well-structured part of the 
curriculum and has a heavier attitudinal component than other 
parts. Its importance h unquestioned. Career education is be- 
coming increasingly widespread at all grade tevek, so career and 
occupational development have been included in the NAEP pro- 
gram. The following are a few highlights of the findings in these 
four learning areas. 

Social studies {Assessment year: 1971*72)^ 

1. In general young Americans from low-income areas* from 
poorly educated families, and from the southeast region are 
less willing than their peers from other groups to defend free- 
dom of the press* freedom of religion, freedom of assembly* 
and other freedoms guarantee<l by the First Amendment to 
the Constitution, 

2. Fewer than half of the Ij-year-olds oin accurately answer 
questions about the American Revolution. 

3. Relatively few young Americans can read and interpret 
graphs, maps, or tables, 

4. Most respon<lents ha^^e little knowledge of the contributions 
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of minority groups to American culture and history. 
Citizenship (Assessment ye^r: 1969-70)> 

1, An overwhelming majority of 17'year-olds (77 percent) and 
young adults (86 percent) know one or more ways citizens 
can influence the actiof^s of their government but fewer 
(54 percent and 61 percent^ respectively) think that ihey per- 
sonally can influence decisions of their state government, 

Z Black 17-year-olds and arJults say that they are willing to ac- 
cept people of a different race in many different situations 
(except political tepresentatlon) at least as often as all Ameri- 
cans of their age, 

3, Seventeen-year-olds and adults in the inner ciry perform near 
or above national levels on tasks dealing with knowledge of 
local governments though they know considerably less than 
young Americans general!/ abou% the federal government, 

4 Young adults in the Southeast are more aware of (oca! problems 
and issues than those in either the Northeast or West, and they 
exceed the national level in thetr belief that they can influence 
local government action! 

Science (Assessment year; 1%9-70), 

1, fn the inner dcy> 17-year-olds have less success in physical 
science than in biological science, while those In rural areas 
reverse this patt*>rn, 

2, Across all ages> young Americans from the affluent suburbs 
handle abstract facts and principles of science well. They do 
best on test items based on science knowledge learned in 
school, 

3. The attitudes and curiosity of school-age blocks about science 
are roughly typical of all school-age American youths but their 
mastery of scientific skills and knowledges is well below na- 
tional levels, 

4. At all four age levels* males demonstrate a more thorough 
knowledge of physical science^ and females seem to have a 
better knowledge of biological science. lYU pattern is par- 
ticularly apparent among young adults, 

Oreer and occupational development (Assessment year; 1973*74)* 
^ Well over three-fourths of the young adults know whether oc- 
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cupaiional groups such as architeas. nnchcrs. lawyers* car- 
pcniers. plumbers, ami soldiers lypically belong lo a union. 
Aboui three-founhs of tho 17-year-oids possess the same in- 
formation, 

2. When real coins arc used to test abiluy to make change* only 
about iwo-ihirds of ihe 9- and 13'>ear-olds realize ihat they 
have not received the correct ch^inge when they are short- 
changed. Similarly* iwo-ihirds of the 13-year-olds are able to 
make the right change for a simple purchase* roughly one- 
fifth of the 9-year-olds can perform this task succebsfully, 

3* Slightly over one-third of the young adult females consider 

homemaking to be their principal job, 
A, Black children of 9 and 13 years of age report doing household 

tasks without help more often than white children of the 

same age^f These tasks include cooking a complete meal for 

a family and Ironing clothes. 

A Sample of Sl^niftCAnt finding!^. HumAnuic^ ant/ fine Aft^ Atca^ 
Rarely do assessments encompass learning areas in the hu- 
manities and fine arts. National Assessment includes three such 
areas— literature, music* and art. Large-scale testing m the l^^i 
two areas has never been attempted before. It is difficult be- 
cause in music and art the measurement of performance (for 
example* singing and drawing} has to be ^ vital part of the as- 
sessment. Here are some of the findings from the literature and 
music assessments. 

Literature (Assessment year: 1970-71)* 

1- Seventeen-year-oids overwhelmingly believe that the study of 
literature is a positive experience* 90 percent believe literature 
should be part of every high school curriculum* and about 10 
percent think that the study of literature increases one's 
tolerance for new and different ideas* 

2, Among blacks* reading is considered a valuable activity* and 
some types of literature are read in greater proportions than 
are read nationally. At age 9* larger percentages of blacks 
report reading poetry: at age 13* considerably larger per- 
centages of blacks read poetry and drama; and ^t age 17* 
^ more blacks read biographies and drama, 
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X Female respondents read more than male respondents^ par- 
ncularly fiction and poetry. On the other hand, males have a 
greater interest in nonfittionp especially biography, 

4, When asked to identify literary works and characters^ 9- and 
l3*year-otds in the central region responded particularly welL 
as did 17-year-olds and young adults in the Northeast, 

Music (Assessment year: 1971-72), 

1, Individuals of all ages are interested In and like music. More 
than 80 percent of a(f age groups either play or would like 
to learn to pfay a musical instrument, 

2, Judged on their abrlity to maintain pitch and rhythm and hit 
the fight notes, fewer than half of the nation's youth can give 
an acceptable vocal performance of their own choosing, 

X Young Americans from the Southeast listen to more music, 
enjoy more kinds of music, and sing more music than their 
peers m other regions, furthermore, black Americans demon- 
strate <i greater abJity to repeat and improvise rhythmic 
patterns »han dn whites, 

4, Most respondents have only a limited knowledge of musical 
notation and terminology. Although they often can Identify 
such notalio-^s as clef signs* note names* sharps* and flats> 
few know that two eighth notes equal one quarter note. Less 
than 15 percent of any age group can sight read even the 
simplest line of music, 

Maior FindEngs: Changes in Levels of Achievement 

The major findings from the fii^^t assessment by National Assess- 
ment are noteworthy in their own right. They display the 
strengths and weaknesses in achievements by American youth to 
a degree never before known. On the other hand* few reference 
points are available to be used when interpreting these data. 

The results of the first assessment can be thought of as ''bench 
marks," With these set upi one can now repeat a major part of 
the ihssessment three to six years lateri and establish a second 
level of achievement that will reveal the direction of changes oc- 
curring and estimates of their sizes. This is invaluable informa- 
tion. The long-term trend of achievement is at least as meaning- 
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fu] for decision making ,is the levels indicated by the original 
a^GSsments. 

The full meaning of the word progress in the title "National 
Assessment of Educational Progress" is now before us, NAEP is 
repeatedly measuring the levels of achievement of young Ameri- 
canSi using about half of the test questions from the first assess- 
ment of each learning area. Great care is exercised to be sure 
that the test items used and the objectives on which they are 
based are sttll pertinent when reused three to six years later. 

Measurements of changes in levels of achievement have 
been completed in three learning areas. They are screncei writ- 
ing, and readings using the schedule shown in Table 3, science 
and writing standard procedures were followed/ though data 
aie reported for school-age groups only. In reading, a "mtm'* 
assessments much more limited than a regular reading assess- 
ment, was conducted. Although a complete reading d>;f«smont 
was conducted in 1970-71, only one age group (17-year-oUis jn 
school) was retosted in 1974^ using a comparatively small part of 
the total number of test items. These questions were extracted 
from the original assessment because thoy seemed to measure 
funaional literacy, that is, the essential knowledge and skills m 
reading required by everyone for effective functioning in society. 

Note that the poriod of time for measuring change is as short 
as three years and not longer than five years. To the surprise 
of some, these are sufficiently lengthy periods of time to reveal 
changes of importance in these three learning areas. This Uci 
alone reemphasi;!es the dynamic nature of education. Constant 
monitoring of its output is highly essential. The following results 
represent the beginning of this effort. 

Changing teve/s o^ 5dence yAcWevemenf 

Changes in level of science achievement were determined 
during a three-year period (or 9* and 13'year-olds and a four- 
yoar period for 17'year*olds, But the results are essentially the 
same in all instances: Achievement In science is declining na- 
tionally To better understand this statements we need to examine 
briefly 1) the meaning of the term science as used by National 
Assessment} and 2) the changes in levels of achievement in 
science for major groups of American youth* such as students 
^living in the Southeast and jn rural areas, 
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Tables 

Measurement of Changes in Levels o\ Achievement 
in Three Learning Areas 





first 


Second 




Period 


Learning Area 


Ass ess f pent 


Assessment 


Age 


of Change 




Vear 


Vear 


Croup 


(Vears) 


Science 


1970 


1973 


9 


3 




1969 


1972 


13 


3 




1969 


1973 


17 


4 


Writing 


1970 


1974 


9 


4 




1969 


1973 


13 


4 




1969 


1974 


17 


5 


ReadinR* 


1971 


1974 


17 


3 



'Mini-assessment of functional literacy only. 

What IS science? In this instance science can best be de* 
hned by examining the objectives on which lest items were 
based. About SO subobjectives within four major objectives were 
used. The major objectives are; 

1. Students should know fundamental facts and principles 
of science, 

2, Students should possess the abilities and skills needed to 
engage in the processes of science. 

3* Students should understand the investigative nature of 
^icience* 

4, Students should have attitudes about and appreciations of 
scientists^ science^ and the consequences of science that 
stem from adequate understandings* 

More than half the test items are associated with the first 
objective^ approximately one-fourth with the seconds and f^w 
with the third and fourth. Moreover* those tied to the first ob* 
jecttve measure knowledge of basic aspects of physical and bio- 
logical science--in other words, the scientific facts and prin- 
ciples commonly taught in elementary and secondary schools. 

National Assessment does not concern itself with college sci* 
ence or the training of scientists. It emphasizes fundamental 
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everyday ^ience thai Amencan youlh should know to be liter- 
ate in this vital arCa, such as scientific (acts about nutrition^ 
health, and our environment. Unfortunately, knowledge cf th»s 
kind of inforniation declined over a three or four year periods 

The nationii picture. For 9-, 13-. and 17-year-olds alike, 
achievement is dropping on most science test questions. This 
occurred with about two-thirds of the test items, while improved 
performance was observed on about one-third. This pattern is 
reasonably consistent in both the physical and biological science 
questions* and v/jth all objectives. 

On the average, the overall drop in science performance at 
each of the three age levels is about 2 percent--too large to be a 
chance occurrence. The signif ance of this amount grows when 
we realize that it corresponds to a lo^s of about one-half year 
of learning experience in science. 

Surprisingly, two important low-achieving gtoups do not fol- 
low the national trend: students in the Southeast and in rural 
areas aajally improved their standing compared to the nation in 
the second assessment m science. In the Soi.theast, performance 
was the same or slightly improved in the second assessment as 
contrasted with the first, while all other regions fell, particu- 
larly the western region for ages 13 and 17- Students attend- 
ing rural schools improved their overall science achievement by 
approximately 3 percent to 4 percent while the nation declined^ 
a truly remarkable achievement. If these trends continue, these 
groups could reach the national levels of performance in less 
than a decade from the time of the second assessment. 

On the other hand, it must be kept in mind that all other 
groups of school-age youth follow the national trend quite con^ 
sistently. For both male and female* black and white, suburban- 
ites and inner-city dwellers, achievement in science is slipping, 

Cbarxglng teve/s of Wriiing AcbiQvQniQnt 

Each of tht- two writing assessments consisted of a number of 
survey questions, multiple-choice questions^ and essay tasks. In 
this way achievement in both general writing ability and writing 
mechanics {punctuation, capitalization, spelling, and word usage) 
are measured. The former is the more difficult to handle in a 
testing situation. The respondents are given a topic to write an 
essay about. In one instance^ 9-year-olds were given IS minutes 
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io write a slory tiboul *i piciure of ti jumping kiingaroo> and 
13- <]iid V-yQ^T'Okh wt»re given 26 mingles (o wrile a descrip- 
tive essay. They wero not msirucled lo edit or rewrite their 
essays but were asked to do their best writing. 

The essays provide two kinds of information. First, we can 
judge their overall quality, including such elements as word 
choice, creative style* expression of ideas, iind deptfi of thought, 
Second, we can tabulate the mechanical errors like misspelled 
words, faulty punctuation* and poor grammar. 

Comparing essays written in 1969-1970 with those written in 
1973-74 reveal some unu^u«)l changes, Heie are *i few highlights 
for each age group: 

Sevc n tec n- y car-o W s • 

1, The Overall quality of the essays declined in five years* and 
the percentage of studer.ts writing good or excellent pipers 
dropped from 65 percent to 76 peECent, 

2, Very good writers are as good as they were in 1969* and there 
are a few more of them. They are writing longer essays with- 
out losrng coherency or increasing their error rates in areas 
such as punctuatton, word choice, spelling, run-ons* fragments, 
and so on, 

3, Poor writers are wo-^e than they were. They are writing 
shorter, less stylistically sophisticated essays but are retain- 
ing about the same error r^ites in writing mechanics. More 
poor essays are incoherent than in 1969, 

4, (n general most aspects of writing generally called mechanics 
and stressed heavily in elementary and junior high school 
English classes are being handled adequately by the vast ma- 
jority of students, and deterioration In their use is not evident 
during the five-year-period. 

Thirteen- year-olds. 

1, The average essay written by 13-year-olds in 1973 is not as 
good as that written in 1969, Fewer essays are excellent, 

2, There is a movement toward shorter, simpler expression. The 
essays were shorter in 1973; this is largely because they con- 
tained fewer phrases within sentences^ Also* the vocabulary 
employed in 1973 was somewhat simpler. 



3. A marked increase appeared; particularly among males. In 
rambling prose, which is somewhat unfocused v^riting contain- 
ing more run-on sentences ana more awkwardness than was 
evident m 1%9. In other words, the percentage of people 
adhering to the traditional conventions of written expression 
decreased. 

4. The quality of the essays by both mate and (emate writers 
droppec* in lour years* and the drop was greater for males. 
Thirteen-year-old females clearly surpass males In general 
writing ability. 

NlnC'-year'-olds. 

1. I he per^ientage of S-ycar-olds writing good or excellent papers 
rose from 51 percent in 197C to 57 percent in 1974. 

2. Nine-year'-olds are writing longer, somewhat more sophisti- 
cated essays, but they are losing some coherence in the process. 

y Most essays by 9-year-olds are virtually free of run-on sen- 
tences, agreement errors, comma errors, period errors, word 
choice errors, and structure work errors. 

4. Very few 9-year-olds write fully developed paragraphs focus- 
ing on a topic sentence, and the percentage is decreasing. 
The most rapid decrease is among the high quality papers. 

Changing teve/i of funcirona/ literacy 

In contrast to the first reading assessment conducted In 1970- 
71, the mfni-assessment of functional literacy Is much smaller 
and more focused. Only 17-year-olds enrolled in schools were re- 
tested, and about 25 percent of the test items used in the first 
assessment were readministered in 1974. Furthermore, these 
questions were selected to present the forrriats of reading ma- 
terials we frequently encounter in everyday life and with which 
we must be able cope to function adequately. The reading 
materials employed are passages such as newspaper articles, 
stories, and poems; com.7ion reference materials used when one 
seeks rnlormation; and graphic materials such as signs, coupons, 
drawmgSf charts, maps, and graphs. Included are questions 
about such things as a telephone bill, a traffic ticket, and an ex- 
cerpt from an insurance policy* 

When administered in 1971 «js part of the complete reading 
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assessment, the tea questions for functional literacy proved to 
be easy ,\ir most 17-year-olds. This is reasonable since the ques- 
tions represent a mmimal level of proficiency in reading; mastery 
is desired. Did the level of success of 17-year*old students rise 
three years later? Yes. definitely. 

All groups gained in functional reading skills, the average 
national level rising 2 percent. Importantly, groups who had the 
loweM levels of achievement on the first assessment gained most 
In other wordb. substantial improvement was found for 17-year- 
old students who ^re male, black. live in the inner city, or have 
parents without a high school education. The average achieve* 
mcnt of the last group jumped neairly 5 percent. 

And, you might ask. what is happening to the two groups of 
American youth who bucked the downward trend in science 
achievement, namely, residents of the Southeast and of rural 
areas? The answer to this question is more encouraging news. 
Of the four regions of the country. 17-year-old students in the 
Southeast improved the most— almost 3 percent on the average. 
Those from rural areas raised their achievement level more than 
their peers living tn other types of communities^ registering a 
sharp gain of more than 4 percent. In total it's a pleasant pic< 
ture to contemplate. 
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OUR SCHOOLS: A SPECULATIVE VIEW 

How comfortable it would be lo offer a simple, direct descrip* 
tion of the quality of our schools. Then we could relax by bounc 
tag a tidy truism back <)nd forth at board meetings, legislative 
hearings, committee debates^ and cocktail parties. 

It iust isn't going to happen. No simplistic statement about 
school quality is possible or ever will be. After all, as compared 
to two decades ago. school buildings are greatly improved^ 
teachers are better educated, budgets are much larger, and cur' 
ricuium materials are more extensive— to name just a few major 
improvements. But are the children better educated? Are their 
needs and the needs of society being met adequately? The evi- 
dence we have says that there are both hopeful and discourage 
ing signs. 

If there is to be a score card on American education, no one 
has yet been clevei enough to devise it. Instead, it is more de* 
sCriptive to view the outcomes of educational effort as analogous 
to some kind of rugged, mountainous terrain, dominated by in* 
spiring peaks here and there, fronted by low ''hogbacks" in the 
foreground, and laced throughout with deep, shadowed can* 
yons. The complexities of this <;cene rival those of the patterns 
of achievement of American youth. Assessment findings show us 
some of the much needed details of these patterns* 

Perspectives About NAEP Findings 

Perhaps the most significant findings of National Assessment are 
so obvious they are overlooked. First, differences in achievement 
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among mdjor groups of ^oun^^ Arnerj(.in<> arc I'xUemely large in 
v^rluallv cill Ictjriiiii^ *iri\ib. Si^^ond, cansisteruly sizable changes 
m leveU oi ochievemcnl in ihroc sumc^^hat di*>sirnitor learning 
areas occur in as short a period as three lo five years. Quite 
powerful forces mui>t be at work, both inside and outside of 
the educational enterprise. 

Croup D///erencei 

It hardly raises eyebrows lo announce that young people 
(oming from ennthed environments succeed well in school 
while those from poor envirunnienti> do not. What is unusuaJ i^ 
the i>ue of these differentes. The achievement levels of those 
from the affluent <>ubu<b. for instance, are typically 6 percent to 
10 percent above the naiion<i] average tn s(hool-*>pe(ific learning 
arejs— learning areai> such as science and mathematics strongly 
influenced b> school participatiun. In contja*>t. achievement levels 
of young Americani> livmg in the inner city are often 10 per- 
cent to 15 percent below the national average in such learning 
areas, bad to sa^, the differences between white and black respon- 
dents are even more extreme. 

In learning areas where the influence of schooling is less 
powerful the ditferonces decrease. In music and citizenship, the 
direction ol diffcreni^L^s among groups is the same, but the sizes 
of the differences are smaller. 

At least two groups show signs of reducing, maybe ulti- 
mately eliminating, therr defktts in achievement. Srhoot^age re- 
spondents living m rural areas and in the Southeast improved 
markedly in two dissimilar learning areas {science and func* 
tiohal literacy^ during a period of three or four years. Moreover, 
there is more good news. One subgroup contributing noticeably 
to the better*than-avera(;e performance of southeastern 9*year- 
olds in science is black students. They gained about 3 percent 
in three years, while in contrast all other black 9-year-olds de- 
clined 4 percent on the average. This needs further study, 

Tho story is different in writing achievement. The writing 
ability of 13-year-olds and 17-year-olds dropped for both male 
and female students. In contrasts the 9*year olds write the same 
or better than four years before. Throughout the age groups, 
^frimmand of the rules of wntmg mechanics did not change much, 
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but respondents seem to write niore like ihey spe^k. The lauei 
is noi a reassuring trend 

Another thought, Aru we satisfied when we discover that 
American youth achieve only a^ well in the second assessment 
as the first that preceded h by three to five years? Consider- 
ing the prodigious effort we make to improve our schools* 
should not our goal be improved performance ratbui than merely 
a steady state? If this makes sense* then declines in science 
achievement and writing ability are even more serious than 
first suppObedi and the improvement m functional literacy simply 
meets our expectations— nothing more. 

Why are the achievement levels not ^mpioving? Are the shifts 
observed due to changes in the schools? In the home? In our 
society? Or in some Imf»raction among all of these? Though we 
C4in only speculate about their rekitive influence* it is helpful 
to identify some of these elements of change that suem to be 
present, 

forces af Worfc 

By age* 17 the typical youny American has spent considerably 
less than one^third (aome say one-fourth) of his waking hours in 
school or school related activities. If we consjdef only the hours 
of actual imtruction in school, the fraction is uven less> perhaps 
on a par with that part of ^ >oung life spent watching television 
programs. Where does this leave the school and its teachers? 
They are powerful factors, but they are not operating alone. 

The single most important input in educational enterprise is 
the students who comes to school heavily molded by the home 
and the society within which it exists. The impact of the school 
may be almost margmaL except for school-specific learning areas 
with a heavy intellectual flavor. The NAEP findings clearly show 
a strong relationship between achievement and student variables 
that are "givens" for the teacher. Is it possible for a school 
system, however good its educational processes, to produce 
high levels of achievement if its students are seriously dis- 
advantaged? Vast improvements can occut, but high levels may 
well be beyond reality. 

Teachers and teaching. School faculties today include a large 
number of university-trained teachersi well schooled in their 
^f'*<ciplines and in the principles of behavioral science, carefully 

ERIC 30 3 1 



certified tind unioni/.cd Thcy tend to worry about the differences 
between "leaching subject mjtler" and "leaching students/' 
favoring the latter, and wondering if they can do both. 

In keeping with this, warm feelings are expressed for "hu- 
manistic'' teachjng— a desire to help the student develop a better 
sense of personal worth. In the eyes of a (5ood number of teach- 
ers—and parents, if limited surveys are to be believed— this is 
the primary goal to be achieved, even if knowledge of subject 
matter is to be sacrificed in part. How a student feels is more 
important than what he or she knows. 

This raises the question of what schools can do best. Beyond 
doubt schools can perform magnificently when engaged in the 
task of enlarging a student's command of arithmetic processes 
or the rules of (grammar. How much can they do to cause posi- 
tive shifts in a student's self-concept, given the uncertainties 
of the methodology used ^nd the heavy inlluence of out-of- 
school factors? Moreover^ if you strive mightily for the second 
goal does it reduce the likelihood of reaching high levels in 
the "basics*'? In short, is our teaching emphasis on self-growth 
a factor that has reduced levels of achievement in traditional 
learning areas and now is causing declines in science achieve- 
ment and writing ability? It's something to think about. 

Another nagf^mg concern is the student reward system. The 
problem of (jrade inflation is widely mentioned and may be of 
the same magnitude as our economic inflation. Virtually all 
schools, including colleges and universities, are searching for 
reasons why high grades are more prevalent now than in the past, 
and Sat achievement scores lower. 

Examine the following line of reasoning. As high grades 
become more common and require only normal effort to obtain, 
they are less meaningful to students, teachers^ and the public. 
Very likely paper-and-pencil tests> the principal component of 
grades^ are also losinf; their punch. Since such tests are based 
almost exclusively on verbal and mathematical skills^ is it reason- 
able to assume that interest in and attention to these skills are 
slipping? If sor the ripple effect of inflated grades is having a 
deleterious outcome on levels of achievement in basic skills and 
various content areas. 

Finally^ grade inflation suggests an unwillingness by at least 
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some le<KhefS to ^pply ae^demic standards syslem^tk^lly. As 
teachers lower thtJit kvvl of L*xpetlation. so ivill students lower 
theifs. Now a gentle toboggan sltde h operating. The best inter* 
ests of all concerned, particularly those of students^ ^re not 
being served, and assessment data reflect this, 

Curnculum and enrollments. Massive changes hove taken 
place in the curriculum m recent years, particularly in areas like 
science and mathematics. To an important degree, the emphasis 
in these learning areas hds moved from "understanding how'' 
to "understanding why/' This to be applauded. On the other 
hand, is it possible that we are doing a better job of teaching 
those who are seriously interested in science and mathematics 
but a poorer job for the lank-and-file student? Otherwise stated* 
are we teaching everyone the principles of an internal combus- 
tion engme when the vast m<ijority have an urgent need to learn 
how to drive better? Certainly there is o place for both experi- 
ences, just as there is for bet theory from "new math" and the 
application of arithmetic processes to consumer problems. Has 
our preoccup*itiun with one interfered with achievement of the 
other? 

Fluctuations of enrollment in sei^ondary sc<iool courses may 
also nudge levels of achievement of 17-y earmolds and young 
adults upward or downward. For instance, slight enrollment de* 
(lines have been delected in the more theoretically oriented 
science courses. It ts conceivable that these courses are succeed- 
ing admirably for those enrolled but have less impact when 
levels of science achievement are measured for an entire age 
group. 

Student mtgralton. The migration patterns of students offer 
interesting hypotheses about achievement leveK reported by 
National Assessment. Good illustrations of this are found in the 
changing achievement levels (or the southeastern and western 
sections of the country. 

In the Southeast, in-migration is comparatively recent and 
includes many white-collar workers. Could this be the cause of 
the improved showing for the Southeast in science achievement 
and functional literacy? 

The western region* dominated by California, has a longer 
^ ary of in-migration. For many year^ families from the central 
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region moved wc^twaid, but this movement has stowed a|.'pieci- 
ably in the t970s. Arc* iniiny of the western yotmg adults ac- 
tually the products of si.hooK in the central region and not those 
of the western region? Does this explain, in part, why these 
young adults perform nedr or above the national a^/erage in vir- 
tually every learning area, while the 9-year-oWs, who are pre- 
sumably the products of western schools, tend to perform at or 
below the national average? If this question is answered af- 
firmatively^ thei: how does one explain tht? fact that between 
l%9-70 and 1972-73 the decline in science achievement for wes- 
tern 9-year-olds was less than the national decline, while those 
for IJ- and 17-jear-olds noticeably exceedc»d the national down- 
wartl trend? 

Student migration within a school district is also a factor to 
be reckoned with. In urban areas> student mobility Is extreme, 
with new faces appearing and familiar ones disappearing in each 
classroom almost daily. In addition^ absenteeism is a problem. 

These conditions are bound to reduce the quality of teaching 
in spite of the be^^t efforts of teachers, particularly when the> 
are trying to indivjduali2e instruction. Could this problem be one 
of the causes of the poor achievement levels of inner-city youth? 
In contrasts schools in rural areas have a much more stable 
studer^* body. Does this factor account for part of the rise in 
achievement levels of youth in rural areas and the Southeast, 
which is heavil> rural? The strength of the influence of student 
migration may be difficult to judge, but it probably is large and 
certainly cannot bo ignored, 

b^fluence o( mtddle-dass values. In the 1%0s a frontal attack 
was made on the so-called middle-class valued of our society. 
This attack was led by college-age youth and drew ^ great deal 
of attention, even though both then and now no one is quite 
sure what middle-class values are. 

The reverberations of the shrill voices of the 1960s still con- 
tinue, but at a lower intensity. What then, has happened to this 
value s^^stem? Probably r( *s bent but not broken, surviving but 
not flourishing. 

Two features are important to us here, First> the strongest 
bastion of these valuer is likely the rural population. Second. 
^ difficult as this value system is to describe, it Is generally 
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agreed tkit it includes the work ethk^ that is, the feeling that 
work is basically noble and rewarding and will lead to greater 
good. Associated with thi', is ihe conviction that upward mobility 
rn our society is facilitated by success in educational en- 
deavors. Schooling is important and must be taken seriously. 

Speculate, if you will about the impact on t>tudent achievement 
caused by any serious eroston of acceptance of the middle-class 
value system. Could such erosion be one of the causes of low 
achievement levels in the inner city and increasing achievements 
in rural areas and ^he Southeast? 

Epilogue. It is patently clear that no one is able to identify all 
of the forces that contribute to high and low levels of achieve- 
ment, and certainly caosal relationships cannot be proved or dis- 
proved. Surveys like National Assessment are not designed to 
probe these matters directly. Instead, they serve as excellent 
vehicles for generating hypotheses about causet> of achievement 
fluctuations, which in turn can be studied more intensively by 
designing appropriate experiments or conducting thorough case 
studies. 

Next Moves 

The design of National Assessment is not remaining static. At the 
same time that it measures changes in achievement that require 
standard conditions to be maintained for each reassessment, 
NAEP is refining its methods and focusing its work more tightly 
on questions about student achievements being raised by edu- 
cators, politicians, and the general public. Prominent among 
these refinements are these: 

1, More frequent use of special probes, that fs, smaller assess- 
ments aimed at topics of great interest. Examples: func* 
tional literacy and basic mathematics, 

2, Addition of more student and school background variables 
and examination of their relationship to changing levels of 
achievement. Examples; average cost of educating a stu- 
dent each year, student migration within a school district 
and between districts, major features of curriculum and in- 
struction such as the use of laboratories in science, 

3, Larger samples that will permit the study of achievement 
of smaller, better defined groups of American youth. Ex* 



jmptes: 17-ycar-old male blacks living in the inner cities; 
9*year-ot(l female whites living in rural areas. 

As National Assessment rs strengthened, it is better able to 
determine accurately the nature and amounts of the outcomes of 
education and their relationship to its inputs and processes. This 
pioneer work also serves as a model for state- and distriawide 
assessments. Many states and a scattering of school districts 
ha>e established regularly conducted assessments, and some of 
these are borrowing heavily from National Assessment's materials 
and methods. As a results action programs to correct deficren- 
cies are being started^ and long-range plans for educational im- 
provements are being formulated. 

Whether or not patterned after National Assessments state and 
district assessments constitute a new ^nd solid data -gathering 
effort and highly informative because they are tailored to 
local interests and conditions rather than national ones. They 
supplement National Assessment, and it supplements them. 

National Assessment findings constitute a superior base on 
which to mount a wide variety of effort: to revitalize curricula, 
teaching methods, textbooks^ and even teacher education. Sys- 
tematic gathering of ai^hievement data during a period of years 
should permit us to draw inferences about the strengths and 
weaknesses of our educational enterprise and should indicate 
where improvements are needed. 

Deficits in achievement suggest both needs of young Ameri- 
cans and needs for renewed educational effort. Iffustratrve of thts 
«s the assessment of the achievements of younji adult:. Findings 
in such diverse areas as consumer mathematics, writing me- 
chanics, functional literacy, career education, and citizenship 
(specifically^ understanding the Bill of Rights), reveal graphically 
the educational needs of this age group. This assists materially 
in the solution of problems associated with developing cur- 
riculum and teuding materials for adult and continuing educa^ 
tion programs. 

All of the foregoing demonstrate that National Assessment 
IS a beginning point, not an end point. Revealing the weaknesses 
in achievement certainly leads to a more accurate direction of 
remedial programs and establishes a base for evaluating therr 
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effecli^encis. Now a beUer foundation (or determining ;]ccount- 
abilily h A\A\hb\Q lo us. 

To be J profe^siontil to be account;]ble. All in (hat role 
must ;]bbume that the> are responsible for decisions made and 
actions taken and are subject to review by those with powet 
to displace them. This ib not as simple as it soundb. For in- 
st<ince^ (or teachers io be accountable, careful consideration must 
be given to the environment within which le^uning is taking 
place. The nature of the student body, the teachmg corKlitions^ 
and a myriad of nonschoot influences must be considered. 

In view of this, it is necessary to prepare a carefully written 
agreement about what is expected to result from the teacher's 
efforts, the agre^.'^ent must be stated in terms of specific stu- 
dent objectives to be achieved. Moreover, criteria for evaluation 
are needed^ with levels of acceptable performance pre-established 
by the reviewer. Now the teacher knows what is expected and 
not expected* 

Assessment procedures and findings assist significantly in 
strengthening accountability efforts* First of all^ lengthy state- 
ments of educational objecti^es^ reviewed and selectively modi- 
fied, can yield specific student objectives that are a part oi a 
hierarchy of objectives* This helps integrate the teaching-learn- 
ing effort, ThoriF test items from assessments can provide effi- 
cient means of gathering data about the degree to which ob- 
jectives have been achieved. Lastly^ national, state^ and district 
assessment findings can be considered bench marks for pre- 
establishing levels of acceptable achievement and interpreting 
the final results. 

The assessment movement arul the accountability movement 
are alive and strongs and education is the better for them. It 
pays to gather systemar'cally large amounts of high quality in- 
formation about all aspec s of our educational system* The more 
we knowF the better wo can decide^and the sooner we will 
improve* 
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